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(54) MULTI-INFORMATION CAMERA 

(57)Abstract: 

PURPOSE: To obtain an index and information 
required for processing by automatically recording 
information, which is not electronically recorded in 
a conventional system, as attendant information 
together with pictures and sounds. 
CONSTITUTION: The absolute position of a 
camera is detected by a camera position 
detecting mechanism 47, and the downward 
distance of the camera is measured by the 
camera position detecting mechanism 47 also. The *i 
change of the camera position and the absolute 
direction and the change of the lens optical axis 
are detected with an angular velocity detecting 
mechanism (sensor) 48, etc., and ambient 
circumstances are detected by, for example, temperature and humidity 
measuring sensors 49 and 50. Brightness information is generated by a 
secondary processing part 38 in accordance with the stop value of a lens 30 
and an output average value detected on an image pickup element 34. These 
various attendant information are constituted in a certain format by a format 
constituting part 39 and are synchronously recorded together with time 
information generated by a time stamp generating part 42 by an attendant 
information recording mechanism 41 . 
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• a camera 21 according to the camera location detection device 47 by an 
ultrasonic reflective measuring method etc. It is detectable by using the high 
gyroscope of a precision according [ a direction and its change ] to angular- 
velocity detection device (sensor) 48 grade absolutely of change of the location 
of a camera 21, and a lens optical axis. 

[0023] By the image pick-up system, it extracts and the result obtained 
according to the decision mechanism by automatic [ focal ] or hand control 
conventionally used with the video camera is taken out from the encoder output 
of the electronic drive system 35 of diaphragm 31 and the zoom device 32. In 
addition, the set point of an electronic shutter 33 is taken out also about 
shutter speed. 

[0024] About a perimeter environment, temperature and humidity are detected 
by the sensors 49 and 50 for measurement, respectively, for example. 
[0025] Moreover, brightness information is generated by the secondary 
treatment section 38 from the drawing value of a lens, and the output average 
detected on an image sensor 34. 

[0026] The format configuration section 39 constitutes such various incidental 
information in a fixed format, it synchronizes with the time information 
generated by the time stump generating section 42, and is recorded by the 
incidental information recording mechanism 41. About an image and voice, it is 
recorded by an image and the voice recording mechanism 40 with a time stump 
according to the recording mechanism of the usual video camera. It not only 
gives the timing of recording mechanism control, but about the 
start/stop/pause of photography, it records the mark information to recording 
mechanisms 40 and 41 which shows a cutting point as a cause of a cutting point 
to the timing of a start. The image between cutting points (shot) is absolutely 
prescribed by time of day with the time stump in this cutting point. Moreover, if 
the frame image recorded to this timing is compressed and it records as a part 
of incidental information, it can be made into a graphical index as a 
representation image of the shot which starts at that cutting point. 
([002lJ In addition, using the information detected by various sensors, or the 
generated information, a real-time operation is performed at the time of record, 
and the information for recording as incidental information is generated in the 
secondary treatment section 38. As the method of generating of secondary 
information, when always recording a processing result at the time of record, 
and when the conditions which the processing itself is filtered and have the 
value of a result are fulfilled, the mark information which shows that may be 
recorded. Although processing / evaluation algorithm in the secondary 
treatment section 38 is set up beforehand, the general-purpose processing of it 
is attained by what they are made programmable for. For example, when 
constant value with the variation of a camera location or a camera optical axis 
is exceeded, the mark information it is supposed that the event which requires 
rapid camera actuation arose is recorded, for example, the camera optical axis 



• » 

• acquired from an angular-velocity detection value — a variation rate — the 
range exceeding a certain threshold can be marked as panning and chill TINGU 
using an amount, or the mark information of zoom-in/out can be given from 
change of a focal distance. 

[0028] Furthermore, a text, a drawing, etc. which serve as narration of the 
information about photography, for example, a photography person with voice, 
and explanation from the exterior with data, such as voice, an image, and a text, 
are inputted from the external input interface 52, and are added as incidental 
infojmation. 

J0O29Li>n the other hand — a photography image — video — if the incidental 
Snfefmation which describes above records on the record medium in which 
random access different from an image is possible, for example, a floppy disk, 
when recording on the sequential record medium / playback medium which is 
deep, retrieval, image analysis primary treatment, etc. will become possible 
based on the information which does not process the image [ all ] itself to the 
processing after record and by which ** is also recorded on it as incidental 
information. For example, by using the information 402 on cutting point 401 A 
currently recorded as mark information, as shown in drawing 4 By being able to 
look through the time information of each cut etc. immediately, and looking 
through immediately and displaying the frame image 403 in cutting point 401 A 
(frame image train 404) The contents list of photography images can be 
performed visually, and coarse summary image edit as primary treatment etc. 
can be realized based on this in a short time, without using actual image 
information. 

[0030] As mentioned above, although this invention was concretely explained 
based on the example, it cannot be overemphasized that it can change variously 
in the range which this invention is not limited to the above-mentioned example, 
and does not deviate from the summary. 
[0031] 

[Effect of the Invention] As mentioned above, since it can be automatically 
recorded on an image and voice, and coincidence at the time of photography 
according to the multi-information camera of this invention, being able to use as 
incidental information information which was not recorded electronically 
conventionally as explained, when carrying out automatic processing of the 
image by the calculating machine after record, the information as an index and 
information required for much more processings can be acquired. That is, the 
incidental information after record gives information required for recognition of 
an image besides momentary processing of retrieval as shown above, edit, etc., 
in case a computer processes an image at the time of image processing. For 
example, image pick-up system condition information and the information on a 
camera location or a camera optical axis give information important for 
presumption of the three-dimension model of *###-ed from an image. 
[0032] Moreover, by processing on real time, adding secondary information as 
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image pickup unit 



video recording unit 
time code generator 
audio recording unit 
microphone 



the sun 



camera 



22 camera operator 

23 object 

24 camera operation 

25 environment 

30 lens 

3 1 aperture 

32 zoom mechanism 

33 electronic shutter 

34 image pickup device 

35 electronic driver 

36 data converter 

37 video/audio processor 
3 8 secondary processor 

39 format converter 

40 video/audio recording mechanism 

41 additional information recording mechanism 

42 time stamp generator 

43 recording start/pause/stop switch 

44 microphone 

45 distance sensor 

46 camera height sensor 

47 camera position detecting mechanism 

48 angular rate detecting mechanism 

49 temperature sensor 

50 humidity sensor 

5 1 other environmental factor sensor 

52 external input interface 



